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SOLVING MAXIMUM CUT PROBLEMS BY SIMULATED ANNEALING 


TOR MYKLEBUST 


Abstract. This paper gives a straightforward implementation of simulated annealing for solv¬ 
ing maximum cut problems and compares its performance to that of some existing heuristic 
solvers. The formulation used is classical, dating to a 1989 paper of Johnson, Aragon, McGeoch, 
and Schevon. This implementation uses no structure peculiar to the maximum cut problem, 
but its low per-iteration cost allows it to find better solutions than were previously known for 
40 of the 89 standard maximum cut instances tested within a few minutes of computation. 


1. Introduction 


Simulated annealing is a classical henristic metho d for solving optimisati on problems dne in¬ 
depen dently to Kirkpatrick, Gelatt, and Vecchi ( Kirkpatrick et al. 1983h and Cerny f Cernv 
19851 1 ■ The maximnm cut problem is a famous NP-hard optimisation problem. The pnrpose of 
the present work is to compare a straightforward implementation of simulated annealing with 
the compntational state of the art for henristic solntion to the maximnm cnt problem as re¬ 
ported by Marti, Dnarte, and Laguna flMarti et al.ll2009l). T his work also compares with Burer, 
Monteiro, and Zhang’s CirCnt henristic ( Burer et ahl 1200111 and Festa, P ardalos, Resende, and 
Ribeiro’s Variable Neighbonrhood Search with Path Relinking henristic (iFesta et ahl 120021 ). 

The maximum cut problem is dehned on a graph G = (V, E) with weights tc : U —)■ Z on its 
edges. It asks for the vertex set S' C U maximising J2uvu&s v&v\s total weight 

of edges with exactly one end in S. S and V \ S here are called the shores of the cnt. 

The maximnm cnt problem is NP-hard ( Karp 19721) — under the assnmption that P NP, 
no polynomial-time algorithm exists f or compnting an optimal solntion to the maximnm cnt 
problem. More is true; Hastad proved ( HastadI 200ll) that, under the assnmption that P ^ NP, 
no polynomial-time algorithm exists that always compntes a solntion whose objective valne is 
within a factor 0.942 of the optimum. 


Goemans and Williamson (jGoemans and Williamson 1995 1 devised a polynomial-time ran¬ 
domised ronnding algorithm based on an SDP relaxation that compntes, with nonzero, constant 
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probability, a solution whose objective value is within a factor a ~ 0.87856 of t he optimum 
when ever w only takes positive values. Khot, Kindler, Mossel, and O’Donnell flKhot et ah 


20071 ) proved that, if the Unique Games Conjecture is true, then even in the case where w only 
takes positive values there is no polynomial-time algorithm that always computes a solution 
whose objective value is within a constant factor larger than a of the optimum. 


Johnson, Aragon, McGeoch, and Schevon fl.Tohn.son et al.lll989l) gave an empirical evaluation of 
simulated annealing applied to a certain graph partitioning problem—hnd the maximum cut 
in a graph with both shores having the same number of vertices. 


Burer, Monteiro, and Zhang fiBurer et al.ll200lh proposed approximately solving a certain non- 
convex continuous relaxation of the maximum cut problem and then using randomised rounding 
on the solution found. With some rehnements, this approach is implemented in the CirCut code 
of Y. Zhang. 


2. Simulated annealing 


Simulated annealing works by taking a random walk on the space of feasible solutions to a 
problem. The random walk considers a random local modihcation of the current solution. If 
that modihcation leads to a better solution, it is always made. If not, it is made with some 
probability that decreases exponentially with the amount of objective degradation. Typically, 
the parameter of this exponential distribution is increased as the number of iterations increases 
(thus reducing the probability of accepting a step that worsens the objective value). This 
parameter, as a function of the iteration count, is called the “annealing schedule.” 


One can represent the space of feasible solutions to an instance the maximum cut problem 
dehned on the graph G = (V, E) as the space { — 1, of functions that specify which shore of 
the cut each vertex lies on. Here, two cuts are adjacent—a single step of the random walk can 
get from one to the other—if they differ in the placement of at most one vertex. This setup 
allows an especially fast implementation of simulated annealing, since the objective function 
change that would be caused by moving a vertex v to the other shore changes o nly w hen v or 
one of its neighbours is moved. (This is the same setup used by Johnson et al.l ( 1989 1 in their 
study of simulated annealing for the closely-related graph partitioning problem.) 


The G-|--|- code in Figured] is an implementation of simulated annealing for the maximum cut 
problem for graphs with integer edge weights and at most 33333 vertices. It accepts input in 
the standard format—one line telling the number of vertices and the number of edges of the 
graph, followed by one line for each edge giving the edge’s two endpoints and its weight. 


The heatmax parameter and the increment 2e-6 were selected because they gave acceptable 
results in an amount of time broadly comparable to that taken by Marti et ah’s Scatter Search 
heuristic on larger graphs. (Whereas Marti et al. take up to 23 minutes on their hardware 
on some instances, all runs of simulated annealing reported here took considerably less than 
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ten minutes.) Since this annealing schedule is oblivious to the size and sparsity of the input 
graph and the magnitudes of the weights on its edges, it is quite likely that a more effective 
general-purpose annealing schedule can be found. 

Note that each iteration of this simulated annealing heuristic takes either a very small constant 
amount of time (two random numbers, one exponential, and a little arithmetic) or time linear 
in the degree of the selected vertex. This allows the code to explore a substantially larger 
number of feasible solutions—about 5 x 10® here—than other approaches might within the 
same timeframe. 


3. Computational experiments 

The simulated annealing code of Figure [T]was run on a computer with an Intel Xeon E3-1245v2 
processor (8 logical cores) and 32 GB of RAM. This computer runs Linux. The code of Figure 
[T]was compiled with optimisation (-03) using GCC 4.9.2. 


GirGut 1.0612 flBurer et al.ll200ll) was run on the same hardware, but compiled according to 
the Makefile distributed with the software. I changed the parameters npert to 300 and multi 
to 25 from the default in order to get better solutions on average. This comes at a substantially 
greater cost in running time. 

I was able to build the maximum cut heuristics, including VNSPR, available from M. Resende’s 
websit^, but I could not get VNSPR to produce good results in ten minutes of computation 
time. Solution values and times for VNSPR reported in this paper are taken from the tables 
lin ked on Opts i com’s websit^, and these very closely resemble those reported by Festa et al. 
in ( Festa et al. 2002fl . The computation times for VNSPR listed here should be assumed to 
have been recorded on a far slower machine—an SGI Ghallenge from the 20th century—than 
the times given for other heuristics. 

I req uested from R. Ma rti the implementations of Scatter Search (SS) ( Marti et al. 2009h . Gir- 
Cut (Burer et al.ll200l[l . and Variable Neighb ourhood Search w ith Path Relinking (VNSPR) 
(IFesta et ahl 1200211 used in the experiments in (IMarti et al.ll2009l ). but my request went unful¬ 
filled. However, Y. Zhang has made available via his website the source code for GirGut and M. 
Resende has made available via his website the source code for all of the heuristics evaluated 
by Festa et al. The solution values and computation times reported for Scatter Search and 
VNSPR are taken from the tables linked on Optsicom’s website accompanying the paper by 
Marti, Duarte, and Laguna. 

Marti et al. report that the hardware they used for Scatter Search is roughly comparable to 
(but slightly weaker than) that used for this simulated annealing code. 


^At the time of writing, http://mauricio.resende.info/src/maxcut-heuristics.tar.gz. 
^At the time of writing, http://www.optsicom.es/maxcut. 
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#define F0R(i,n) for (int i=0;i<(n);i++) 
vector<pair<int,int> > edges[33333]; 
int n, m, side[33333], chg[33333]; 

int mainO { 

if (2 != scanf ("°/oi°/oi", &n, &m)) abort (); 
while(m—) { 
int a, b, w; 

if (3 != scanf ("°/oi°/oi°/oi", &a, &b, &w)) abortO; 
a—;b—; 

edges[a].push_back(make_pair(b, w)); 
edges[b].push_back(make_pair(a, w)); 
chg[a] += w; chg[b] += w; 

} 

F0R(i,n) side[i] = 1; 
int obj = 0, best = 0; 
double heatmax = 10000; 

for (double heat = 0; heat < heatmax; heat += 2e-6) { 
int k = randO '/„ n; 

if (!(drand48() > exp(heat*chg[k]/best))) { 

obj += chg[k] ; side[k] = -side[k]; chg[k] = -chg[k] ; 
for (auto e : edges[k]) { 
int V = e.first; 

chg[v] += e.second * (2 - 4 * (side[k] != side[v])); 

} 

if (obj > best) { 

F0R(i,n) printfC °/oi", side[i]); printf ("\n"); 
best = obj; 

} 

} 

} 

} 


Figure 1. A simulated annealing heuristic for maximum cut in C++. 


The comparison was run on three sets of test cases, all retrievable via Optsicom’s website. 
Following Marti, Dua rte, and Laguna, these are called Sets 1, 2, and 3. Set 1 was generated by 
Helmberg and Rendl (iHelmberg and Rendlll2000l) using G. R inaldi’s graph gen erator rudy. Set 


2 was generated by Festa, Pardalos, Resende, and Ribeiro fiFesta et al 


pngeni 
1 120021 ) 


from Ising spin 


glass models. Set 3 has four graphs from the 7th DIMACS Implementation Challenge. 
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Results are given in Figures [2], [3], and HI The first column of each row gives the name of the 
graph. The columns labelled SS, CirCnt, VNSPR, and SA give the objective valne of the best 
solntion fonnd by each henristic. The adjacent colnmn labelled Time gives the compntation 
time, in seconds, reqnired by that henristic. 

A snmmary of the results is given in FignreO The first colnmn gives the nnmber of the dataset 
in qnestion (1, 2, or 3). The columns labelled SS, CirCnt, VNSPR, and SA give the nnmber 
of graphs in that dataset on which each henristic found the best solution of the fonr. The 
adjacent colnmn labelled “only” gives the nnmber of graphs in that dataset on which each 
henristic found strictly better solutions than the other three heuristics. 

The simulated annealing code in Figure [T] fonnd the best solntion of the fonr henristics on 61 
of 89 instances. The tables distributed via Optsicom’s website appear to list the best solution 
of SS, CirCnt, and VNSPR as the best solntion known. Assnming this is accnrate, the code of 
Figured] fonnd solntions better than the best previously known solntion in 40 of 89 instances. 
When also comparing against the CirCnt rnns in this paper, the code of Fignredl fonnd solntions 
better than any solution fonnd by any other henristic tested in 36 of 89 instances. 

It bears mention that the annealing schednle can be modified in order to get mnch better results 
on some cases. For example, changing heatmax to 40000 and the increment to heat to 5e-6 
finds a solntion to case g35 from Set 1 of objective valne 7685, which is better than those fonnd 
by any other henristic. Rnnning with different random seeds can also prodnce better results; 
inserting the call srand(3); at the beginning of main and rnnning on case toursg3-8 from Set 
3 gave a solntion with objective valne 41684814, matching CirCnt’s solntion. I made no special 
effort to optimise the annealing schedule, and the resnlts reported in the tables above represent 
a single rnn of simulated annealing using the default random seed. 


4. Conclusion 


The resnlts in this paper appear to show that a simple-minded implementation of simulated 
annealing can often compnte within a modest timeframe better solntions on widely-known 
instances than the best algorithms that have been applied by the metahenrist ics commnnity 


to the maximnm cnt problem. The formulation nsed dates back (at least) to I.Tohn.son et ah 


(119891) . This highlights the need to consider simple, classical approaches as well as more modern 
approaches when assessing the state of the art for solving any particnlar problem or establishing 
a baseline for a compntational stndy. 


This should not be considered an endorsement of any particular implementation of simnlated 
annealing. The henristics involved were run nnder different time limits, with different termina¬ 
tion conditions and on different hardware. An obvious refinement of this work—for a researcher 
with access to Marti et ah’s Scatter Search code—would be to compare all of the heuristics 
considered here on the same compnter with the same, fixed, time horizon. 
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Graph 

SS 

Time 

CirCut 

Time 

VNSPR 

Time 

SA 

Time 

gl 

11624 

139.0 

11624 

243.378 

11621 

22732.0 

11621 

294.680 

g2 

11620 

167.2 

11600 

230.651 

11615 

22719.0 

11612 

327.224 

g3 

11622 

180.1 

11621 

220.899 

11622 

23890.0 

11618 

295.132 

g4 

11646 

194.4 

11633 

186.158 

11600 

24050.0 

11644 

294.280 

g5 

11631 

205.2 

11630 

322.106 

11598 

23134.0 

11628 

299.572 

g6 

2165 

175.7 

2178 

209.259 

2102 

18215.4 

2178 

246.516 

g7 

1982 

175.5 

2006 

251.745 

1906 

17715.8 

2006 

204.756 

g8 

1986 

194.9 

2004 

204.970 

1908 

19333.8 

2005 

206.232 

g9 

2040 

158.0 

2052 

223.100 

1998 

15224.5 

2054 

205.500 

gio 

1993 

209.7 

1996 

217.800 

1910 

16268.9 

1999 

204.992 

gll 

562 

171.8 

558 

63.512 

564 

10084.0 

564 

188.928 

gl2 

552 

241.5 

554 

38.496 

556 

10852.0 

554 

188.712 

gl3 

578 

227.5 

578 

103.056 

580 

10749.0 

580 

194.996 

gl4 

3060 

186.5 

3057 

97.148 

3055 

16734.0 

3063 

252.456 

gl5 

3049 

142.8 

3037 

73.096 

3043 

17184.0 

3049 

220.432 

gl6 

3045 

161.9 

3047 

86.183 

3043 

16562.0 

3050 

219.472 

gl7 

3043 

312.8 

3043 

125.603 

3030 

18554.6 

3045 

219.464 

gl8 

988 

174.3 

988 

79.426 

916 

12578.3 

990 

234.828 

gl9 

903 

128.3 

902 

71.282 

836 

14545.6 

904 

196.020 

g20 

941 

191.0 

940 

77.651 

900 

13325.6 

941 

194.644 

g21 

930 

233.1 

929 

93.120 

902 

12884.6 

927 

194.656 

g22 

13346 

1335.8 

13352 

457.417 

13295 

197654.0 

13158 

294.572 

g23 

13317 

1021.7 

13324 

363.187 

13290 

193707.0 

13116 

287.836 

g24 

13303 

1191.0 

13319 

388.584 

13276 

195749.0 

13125 

289.108 

g25 

13320 

1299.2 

13333 

324.094 

12298 

212563.3 

13119 

315.668 

g26 

13294 

1415.1 

13313 

467.400 

12290 

228969.4 

13098 

288.544 

g27 

3318 

1437.5 

3326 

368.070 

3296 

35652.3 

3341 

214.312 

g28 

3285 

1314.0 

3286 

344.389 

3220 

38654.8 

3298 

251.784 

g29 

3389 

1265.8 

3390 

411.182 

3303 

33694.5 

3394 

214.440 

g30 

3403 

1196.3 

3405 

479.210 

3320 

34457.5 

3412 

214.628 

g31 

3288 

1336.2 

3293 

372.585 

3202 

36658.0 

3309 

214.044 

g32 

1398 

900.6 

1390 

153.000 

1396 

82345.0 

1410 

193.964 

g33 

1362 

925.6 

1354 

119.342 

1376 

76282.0 

1376 

194.092 

g34 

1364 

950.2 

1370 

194.402 

1372 

79406.0 

1382 

194.116 

g35 

7668 

1257.5 

7672 

335.542 

7635 

167221.0 

7485 

262.772 

g36 

7660 

1391.9 

7656 

264.945 

7632 

167203.0 

7473 

265.460 

g37 

7664 

1386.8 

7672 

340.885 

7643 

170786.0 

7484 

287.644 

g38 

7681 

1011.5 

7674 

364.396 

7602 

178569.8 

7479 

263.840 

g39 

2393 

1310.9 

2393 

264.634 

2303 

42584.2 

2405 

209.412 

g40 

2374 

1166.4 

2387 

279.101 

2302 

39548.9 

2378 

208.376 

g41 

2386 

1016.5 

2398 

239.882 

2298 

40025.0 

2405 

208.136 

g42 

2457 

1458.2 

2465 

278.497 

2390 

41254.5 

2465 

210.452 

g43 

6656 

405.8 

6658 

167.068 

6659 

35324.0 

6658 

245.056 

g44 

6648 

355.9 

6649 

124.051 

6642 

34519.0 

6646 

241.360 

g45 

6642 

354.3 

6649 

127.257 

6646 

34179.0 

6652 

241.496 

g46 

6634 

498.1 

6634 

118.105 

6630 

38854.0 

6647 

244.896 

g47 

6649 

359.1 

6655 

106.296 

6640 

36587.2 

6652 

241.848 

g48 

6000 

20.1 

6000 

54.245 

6000 

64713.0 

6000 

210.248 

g49 

6000 

35.1 

5940 

85.079 

6000 

64749.0 

6000 

210.180 

g50 

5880 

26.8 

5876 

156.548 

5880 

147132.0 

5858 

210.864 

g51 

3846 

513.0 

3841 

99.264 

3808 

89965.5 

3841 

233.704 

g52 

3849 

550.8 

3840 

146.937 

3816 

95984.5 

3845 

228.092 

g53 

3846 

423.8 

3840 

103.453 

3802 

92458.8 

3845 

230.052 

g54 

3846 

429.0 

3850 

142.984 

3820 

98458.0 

3845 

228.340 


Figure 2. Comparison on Set 1 instances. 
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Graph 

ss 

Time 

CirCut 

Time 

VNSPR 

Time 

SA 

Time 

sg3dl051000 

110 

1.9 

110 

6.178 

104 

1196.7 

110 

188.600 

sg3dl052000 

112 

1.9 

112 

6.070 

106 

1196.7 

112 

188.132 

sg3dl053000 

106 

2.1 

106 

7.272 

102 

1196.7 

106 

188.648 

sg3dl054000 

114 

2.1 

114 

8.468 

106 

1196.8 

114 

188.856 

sg3dl055000 

112 

2.3 

112 

5.318 

106 

1196.7 

112 

188.356 

sg3dl056000 

110 

2.1 

110 

5.872 

108 

1196.8 

110 

189.532 

sg3dl057000 

112 

2.0 

112 

4.465 

108 

1196.8 

112 

188.196 

sg3dl058000 

108 

2.1 

108 

5.667 

106 

1196.8 

108 

188.432 

sg3dl059000 

110 

1.8 

110 

5.544 

104 

1196.7 

110 

188.660 

sg3dl0510000 

112 

1.4 

112 

7.105 

106 

1196.7 

112 

188.284 

sg3dll01000 

882 

406.1 

884 

106.747 

892 

20409.0 

890 

190.900 

sg3dll02000 

894 

302.4 

894 

67.125 

900 

20873.0 

900 

190.944 

sg3dll03000 

884 

410.4 

878 

83.015 

884 

20574.0 

888 

191.540 

sg3dll04000 

892 

485.9 

894 

100.869 

896 

19786.0 

896 

191.020 

sg3dll05000 

880 

400.9 

876 

72.593 

882 

19160.0 

884 

191.100 

sg3dll06000 

870 

461.8 

876 

119.428 

880 

17872.0 

888 

191.012 

sg3dll07000 

890 

386.2 

892 

117.473 

896 

21044.0 

898 

191.204 

sg3dll08000 

880 

466.9 

876 

116.292 

880 

19760.0 

878 

191.332 

sg3dll09000 

888 

493.6 

896 

77.126 

898 

20930.0 

898 

190.880 

sg3dll010000 

886 

352.8 

886 

86.571 

890 

20028.0 

894 

197.388 

sg3dll41000 

2428 

1320.6 

2416 

334.266 

2416 

188390.0 

2442 

204.244 

sg3dll42000 

2418 

1121.1 

2440 

333.137 

2416 

187502.0 

2454 

201.704 

sg3dll43000 

2410 

1215.8 

2416 

340.113 

2406 

190028.0 

2438 

201.728 

sg3dll44000 

2422 

1237.2 

2420 

311.276 

2418 

198809.0 

2444 

201.828 

sg3dll45000 

2416 

1122.5 

2422 

347.010 

2416 

196725.0 

2438 

202.732 

sg3dll46000 

2424 

1213.9 

2428 

319.165 

2420 

189366.0 

2440 

203.872 

sg3dll47000 

2404 

1230.6 

2416 

326.425 

2404 

187902.0 

2432 

201.508 

sg3dll48000 

2416 

1132.0 

2426 

328.149 

2418 

194838.0 

2436 

201.556 

sg3dll49000 

2412 

1213.9 

2394 

344.832 

2384 

193627.0 

2420 

237.256 

sg3dll410000 

2430 

1125.8 

2426 

315.461 

2422 

196454.0 

2452 

201.628 


Figure 3. Comparison on Set 2 instances. 
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Graph 

SS 

VNSPR 

Time 

Time 

CirCut 

SA 

Time 

Time 

toursg3-15 

281029888 

1023.2 

283538879 

539.032 


264732800 

89044.6 

284493491 

218.204 

toursg3-8 

40314704 

65.7 

41684814 

50.527 


41106855 

36512.3 

41593110 

191.472 

tourspm3-15-50 

2964 

333.4 

2982 

411.101 


2834 

55083.9 

3008 

240.492 

tourspm3-8-50 

442 

48.5 

454 

30.208 


398 

9215.2 

458 

191.124 


Figure 4. Comparison on Set 3 instances. 


Set 

Set size 

SS 

only 

CirCut 

only 

VNSPR 

only 

SA 

only 

1 

54 

16 

9 

16 

11 

9 

2 

29 

19 

2 

30 

11 

0 

11 

1 

5 

1 

29 

16 

3 

4 

0 

0 

1 

1 

0 

0 

3 

3 


Figure 5. For each set, how many times each heuristic discovered the best 
solution among the four. 
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